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ABSTRACT 

This paper develops a aodel for generating sets of 
replicable iteas for testing a range of reading skills in the priaary 
grades* The procedure is particularly ccncerned aith tests to 
identify a child's profile in reading achieveaent and to infora a 
teacher^ principal^ or district of the actual level' of achieveaent in 
reading. Although the aodel is aore general, this application focuses 
on only tvo aspects of reading: coding and decoding skills and 
reading coaprehension. (AA) 
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For many decades, a lot of hard work has been devoted to research 
in primary reading. The study of methods, basic programs, and reading 
failures..., has been highly emphasized while more fundamental problems 
have been neglected. 

In th.is context, the -evaluation of primary reading achievement has 
been rather Doorly approached. 

J. Chall notes (1) that tJhe comparison of methods (looK-say, 
systematic^honics or intrinsic phonics) is very difficult and biased by 
the large diversity of the means used by the investigators when evaluating 
reading achievement. She comperes, therefore, any available studies accord- 
ing to eight measures of reading -ability. 

1. Utird pronunciation 

2. Connected oral reading 

3. Phonics 

4. Spelling- 

5. Vocabulary 

'5. Silent reading comprehension ^ 

7. Rate of reading 

8. Interest, fluency, expression. 



(1) J. CHALL, 1967, 



However, it must be emphasized thaf labels such as "silent reading 
comprehension" are very imprecise. J.. Chall again defines "silent reading 
comprehension" as "the ability to understand material read. Sometimes called 
paragraph reading, this is usually part of a standardized silent reading 
test. The child reads 'selections and answers questions to show that he 
understands them. Like the vocabulary subtest, the comprehension subtest 
measures an indeterminate combination of skills and is affoctod by rate of 
reading". It would be impossibla to confess "more explicitly tho inability 
of the reading researcher to define clearly what he plans to measure. 

Ws are convinced that no substantial progress can 'be expected in 
the domain of reading evaluation without a l'arg-3 amount of research devoted 
to tf ooretical problems. 

Bofcre proposing a tentative way for the evaluation in primary 
reading (1st and 2nd grades), lot us list what sesms to us the most impor- 
tant handicaps to any progress in the knowledge of primary reading: 

In a selective system, the explicit Cor implicit) objactive of 
reading tests is to ciscertain 'which children v>;g havo to retain 
in the low grades". In a more democrstic system, the reading 
tests help answering tho question: "Which child needs remedial 
instruction in primary reading Though the tests yiald 
accurate and reliable composite scores, they do not provide, 
sxcsptQd in a few crises, any further data about specific apti- 
tudes or deficits of the child, 
b) PGopls interQSted in reading instruction are mostly teachers, 
princioals, administrators, basic readers publishers, test 
publishers,. . Few cf them are trained in linguistics or are 
highly interested in theoretical problems related to reading 
evaluation. 
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c) No test sxplores the whole ran^e of reading behaviors. 

d) No critorion-reforencod procedure is used for selecting or 
writing items i as 3 consequencG, a too large amount of freedom 
is left to the tost-writer. 

In this paper, we suggest a new way for generating sets of repli- 
cable items for testing a wide range of reading behaviors. This procedure 
could be of considerable helo for the researcher with following objectives: 

a) Identifying a child's profile in reading achievement. 

b) Informing a teacher, a principal, a district or board ariminis- 

^ : tratcr of the actual level of achievement in reading instruction. 

To Serin with,^wo have focused our attention two aspects of 
-reading evaluation only: coding an-! decoding skills, and ^reading comprehension 

Lei us first consiiior the problems concerning the ccderv/e shall ne^t describe 

» - ^ ^ ' 

a model convenient for reaiing comprehension evaluatiorj. ;/ / 



CODING ANO OECbqiNG SKILLS. 



The model designed for evaluating the code aspscts will be useful 
if "most items (ideally all of them) used in standardized tests can be 
generated through a nearly autortiatized procedure and classified according 
to the dimensions cf the model.' 

- : . 
The first dimension refers to the media used by the test adminis- 
trator for asking a question and by the student for answering it. Three 
categories (written question and written response, written question and 
oral response, oral question and written response) are included in the 
model. ^ ' . 

The second dimension refers to the kind of operation performed by 
a student for completing the itam. Two levfels, recognition and production 
may be required. In the case of "recognition" the subject has to select 
one or more correct responses among n decoys for matching a stimulus.. 
In the case cf "production" the subject has to construct one or more 
correct rospcnses matching a stimulus. 

The third dimension refers to the linguistic material used in any 
specific item. Five catORories are related to this dimension: letters 
and sounds, Syllables, wofds, sentences, paragraphs. 
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The whole model cbmprises 3 x 2 x 5 « 30 cplls. 
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From this model, it provas very easy to derive the items connected ^ 
to any cell. We must, however, bsar in mind that such a model is useful if. 
the items may be derived through a standardized criterion procedure. It must, 
moreover, be emphasized that the derivation procedures may vary according to 
the goals pursued by the tesl^-writer. A review of the goals attainable 
through the model and of the moans which could be used for that purpose will 
be found at ths end of this paper. 
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Let us now consider which items correspond tc each cell of the table 
and which construction prcbien^o we encounter. 

1. A possible item derived from th3 cell number 1 would be: 

"Chcosa from among four letters the same as the letter in front" 

Two remarks about this item: 

a) No genuine reading takes place. Without 'any exposure to reading 
teaching, a child could complete tMs item which could, however, 

be found in reading readiness tests. ^ 

b) A criterion procedure can be used for deriving these items by 
selecting a random sample cf letters as stimuli. The decoy? are 
also randomly selected from the 26 letters of our alphahet or 
from any sub-population of letters which offer some i<raphic 

■ ' " characteristics. Visual discrimination studies could possibly 
indicate ths bost sub-population of letters usable as riecoys. 



2. Items corresponding to cells 2-3-4-5 can ho derived the same way. 
The population of letters, sounds and syllables is however finite. 
The populati'^n of wcr^is, sentences cr paragraphs is infinito, but it 
is quits possible to define finite suff-populations (Examples: words 
belonging to a basic vocabulary list*, meaningless words created by 
adding given syllables or sounds, sentences drawn from a basic - reader, . . 

As previously stated,' such sub-,jopulations have to be defined according 
to the otjQctives of the tGSt-v^riter. 



Items derived from cells number i-tO aim at testing tha ability to 
copy different materials. 

In a more general way, items ;ieriveri from cells number 1-5 and 6-10 
do not call for genuine reading ccdin? nr decoding skills. No trans- 
lation is mqde inrisBc: from a written m^.terial to an oral one or conver- 
sely. Items derived from cells'l-5, moreover, -de not require any 
learning of roadinR. Items derived from^cells number 6-7 an^^ in some 
cases from cell number 8 require only visual discrimination^ skills 
plus psychomotor skills, but no systematic learninp, of reading. 
We have included these items in the model as pre-coding items for 
at least two reasons: 

a) Though"°^onuine reading takes place, those items are, however, 
prerequisites for reading Iccrning. The ability to cope with such an 

' abstract material could possibly "be a good predictor of reading' 
achievement in the first grade. 

b) In fact, we call "reading skills" all the skills related in any way 
to printed linguistic rraterial. Thus, we have not included in the 
model items combining oral questions "and oral responses (Example: 
identify a spoken vior6 among an oral choice). We are, however, aware 
that such items are very important as prerequisites for reading 
learning. They will be discussed hereafter, when we will consider 
more thoroughly items derived from cells 1-6-11-16-21-26. 

. Items corresponding to cells 11-15 may be derived by a simila'^l^tlce- 
dure. A letter "p", for instance, is given as a written stimulus. 
The test administrator or a tape recorder utters sounds such as /p/, 
/a/, /b/, /u/. The student has to identify the correct sound. 
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B. Items corresponding to ceils 16-20 moasure the ability to read orally 
letters, syllaKles, pantographs,... 

• ^ . • f • 

7. Items nerivs'^ from cells 21-25 c»rc constructed according to the Same 
procedure.' These items are road by the test administrator. The student 
has to select the correct answer among writtoh decoys. 

6. Items derive:- from cells 25-30 measure the ability to transcribe 
letters, syllables, . ^ , paragraphs spoken by.the test administrator 
(dictation) • , . . \ ^ ^ . 

% el 

9. Cells 5-14-15-20 have been included in the model for comprphensivonessj 
WQ are aware that items derived from these cells are not very impor- 
tant and are even unrealistic - 



So f^5r, our approach to item derivation has been rather theore- 
ticc^.l. Now, let us look £3t the problem cf item construction and sampling 
from a more practical point of view. For instance, what are the problems 
to !-G solved for designing items corresponding to cells 1-6-11-16-21-26, 
i.e. all items related to letters end sounds (1). 



CI) This part of the study has been conceived for the French Language. * 
Discrepancies exist in this respect between French and English. 
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a) Items derived from colls 1 and G require mainly visual recognition of 

a graphic feature according to several clues (1). 

- left ojr right-oriented ex. / 

- single or douMe ex. ^ ^ © 

- up or down-opiented ex. 



curled or not 



i 

b) Any stimulus or decoy relative to an item from cills 11-16-21-26 is 
characterized hy phonological and graphic features. Phonological 

-Features of spunds have not heen doscrited heretofore for the model 

doos not include items made up.of oral questions anfd oral rosponses, 

• Defers examining items derivad from the ceils 11-16-21-26. we have 
!to deal with phonological features of sounds such as: 

- voiced - non voiced ex. /t/ vs /d/ 

- stop - nan stop ox. /p/ vs /f/ 
T bilabial - dental ex. /p/ vs /t/ 

- oral - nasal ex. /a/ vs /a/ 



If we simultaneously taka into account graphic properties o^ 
letters and phonological features of sounds, we understand easily that 
stii^uli and 'Jscoys may be derived by a criterion procedure. 



(1) The relative Irrportanca of these clues might bs assessed by means 
of experimental studies. Sec, for instance, E.B'. COLEMAN, 1970, 



2nd H,M, POPP, 1964. 
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For instance, sui^-scmplss of items may randomly be derived from 
following suir-populations of letters ?nd scun-is and ara rspresentativc 
samples. 

1. UnlVGce^l corrggponr^pnce 

1.1. One sound corresponds to ono letter. The correspondence is 
biunivocal. 
^ Ex. i r, p, V, 

From- those sounds, Wt2 may select wsll-identified stimuli and 
• decoys. v 

1.1.1. The stimulus anc tho dGcov(s) -differ ^y ono ptjopological clu'J 
whilo.thgir graphic features differ by two clues at laast . 



Ex. 

% 



Phonological cluss 



+ consonant 
+ stop 
+ lahial 
non voiced 



1r 



+ consonant 
+ stop 
+ labial - 
♦ voicod 



Graphib-^fsatures 



non curled 
r^ht -oriented 
single 



HE 

curlod 

right -oriented 
sinclG 
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1 ..1 .2v-' lThe stimulus Ftn> the :^eccy(s) rjjffcr one ?;raphlc cluo whllg 
thGir phonclor.ic?^! fceturQS differ \ry two cIugs at loast. 



Ex* : 



Phjnologicc-1 clues 



voiced 
non stop 
consonant 
1 at oral 



• non vcicGC^ 
stop 

consonant 
fiontal 



Graphic .features 



^ up 

! riF,ht -orient er^ 
; singla 
curled 



up 

right -oriented 

single 

non curled 



1.1.3. Thu stin^ulus -^.n-i th3 decoy (s) differ by one pxaphic an-^ one 
phcnclctyical clue > 

Ex.: ■ , 



PhcnolDgic^l clues 



. consonant 
nasnl 
voiced 
dental * 



consonant 
nesal 
voiced 
^dlabial 



Graphic features 



up 

sinrlo 



up 

dcublG 
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.2. A sound is writ ten with a sot of letters. 
The corrcspondanca can bo: 

- Biunivoc^l: in French the sound' /u/ "is always written ou, 

and ou is always spoken /u/ 

- Univocal (graphic) : the graphic set of Idtters au is always 

spoken /o/ (but /o/ can be written as , 
0 , 3u or eau } ♦ 

- Univocal (phcnemic): the sound /!" / is always written ch 

(^ut cHt can be sooken // / or /k/1 • ' 

Multiple correspondence 

All linguistic data to bs tasted in thir^omain x^z^] bo c^oscritred 
at i^est according to two dimsnsions: 

- The direction of the decoding scheme 

?^ W to 0: given lbttl?"or s«t of letters can be orally trans- 
coded into ciffcront sounds. 

i:} 0 to W: a givan phonamc can^be transcri^jed with different 
letter's or s:;ts of letters. 

- Tho distr.irution cf tho allonorphs is., either governed by contextual 
constraints cr is convcntianrj. In the letter case no rule does ■ 
exist: tfte graphic or the phonological foatures cf words havo to be 
mornorizod. ... ' ' 
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It is, therefoFG, quite impossible to test multiple corrospon- 
doners from sounr's isolate- from words. Multiple correspondGnces have 
to .^e tests:* within words. Items will thus aim at testing: 

a) The eirility of the sturient tc identify the different decoding 
schemes. 

t] The knowle^'ge of the contextual constraints allowing to select 

one decoding scheme from emon?. other possi!:>lo schemes, 
c) The ccerncrizing of conventional graphic of phonological features. 



Let us have a looK to some possi' Ic linguistic data to be 



tasted: 



\ 1 

Allomorohs aro distri^^uted Allomorphs are distributed • 

accor^ins contextual constraints * " conventionally 



a. 0, u /g/ 



ch / / ex. (chat) j 
-> /k/ ex. (clTT^tien) j 
r 



'^etween vowels /z/ 
*~GforG consonants /s/ 



x^ /ks/ (ax^e) | 

/z/ (di^iemc) 
/s/ (dix) 



c^, u /k/ 
i /s/ 



/*/ before bila!:ial3 /p/ 
i or /b/ cm 



en 
an 



ex. oendant 
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B. READING COMPREHENSION 



Let us refer as^ain to the J. Chall'^ definition- of "silent 
readinp compfohension" quoted atave (p. 2). It is confessed that "silent 
rQ?/':ing^sts maasura an indeterminate combinitian of skills". The entire 
responsibili^tyN^ the situation cannot rely oK testwriters only since 
no exhaustive theo -y of reading comprehension has "been developed so far. 
When such a theory is available, ^the construct validity of reading tests 
will increase accoi-dingly. In the meantime reading test-constructors 
but depend upon existing theories. 



can 



If, «fpr instance, we want tc test the ability of a student to 
un-'orstand tha content of a first or second grade passage, wa construct 
four sub-samples of items. 

* » 

1. Itoms measuring knowledee of the vocatrulary use':^ in the passa^re. 

2. Items measuring' msst'ery of the' synt^^ctical structures *' 

3. Items measuring ability to rely upon anaphoric relations ^ 
4/ltcfps msasurinB ^^ility to use ccmpensatory devices which supply 

the deficiencies of informations. 

1. Vccalrulary 

First of all, ws list the words which are absentees from 
basic vocabulary list. For the French lanfifuaec, we use thu CREOIF 
list (1). Accordinf! to our purpose, we take into account., either .tho 
whols population of these words, or a r-indomized sub-sample of a . 
civen size. 



(1) GOUGENHEIM, 19,64. 



r 
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In a seccnC step. ,we road in the dictionary (1) the dafinition 
of every word selected (accorcilnr to the specific usa of the word in 
the pessajte) . • .* 

Ex. Cimc: "Hirhost part of d trea or a mountain"." 

From this definition, w-3 draw the semic schema of the word. 

. Ex. Cimo:-* axtremity' . + 'up', + 'tree' 

'mountain' 

In a t^rd steo. wg look in a dictionary (2) providinp, synonyms 
and antonymslor words that complete tha semantic space of the word 
undor consideration. 



(1) J. DUBOIS, 1957. 

(2) R. 8AILLY, 1971 



lb 



f 



The following semic schema is then built. 
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Contextual ssmas 




CD E F 

(Tree) (Mountain) (Buildinr,) (Man) 



CIME 

SOMMET 

FAITE 

(toit 2) - 
CRETE 
TETE (2) 
l.E HAUT (2) 



+ (1) 

+ 



o 

o 
o 

+ 



+ 
♦ 

o 

0 
+ 



o 
+ 
+ 

o 

0 



o 
c 
o 

o 
+ 

c 



POINT E (2) 
BOUT (2) 
BORD (2) 
LIMITE 



oA 



+ 

G 
O 

o 



0 
0 

0 ' 

0 



0/+ 
0 
0 
0 



o 
o 
o 



F(jND (2) 
^lED (2) 
BASE 

IE DAS (2) 



o 
+ 



+ 
+ 



o 
+ 

o 



(1) + : thG wor':^ is positively marked for a riven scmQ ex. cime : + up. 
- : the wor^'' is negatively marked fcr a given seme ex. fond : - up. 
0 the vjorf' is neither positively neither neratively marked for a 

nivcn srjme, i.e., th3*S(^me does not helonr to the semic scheme of 
the word.' 

o/+' : neutralized semes. The some is unspecified for the neutral 
mesnini?, of the word, but for the marked meanings it can be 
specified as +., 

(2) Words belonginp to the basic vocabulary. 
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From this table, ons can easily derive items testing: 
a) The aemic Kernel (soma B)^ 



by selecting as decoys: 



all the words having a + for the seme5?\ 

r 



la cime 



la tete ? 
l9 haut ? 
la pointa ? 
le bout ? 
le bord ? 
le fond ? 
le pied ? 
le bas ? 



or a sub-samp.le: 
la cime 



Is haut ? ' 
le bord ? 
. le bas ? " ■* . 

b) Jho contextual seme "tree'* (se^mQ C) 

!:y selection as decoys all the words havinjr a + for semes A and B: 

'l2 cime = / le toit 

« 

Jla tSte 

- , ' Ic haut - d'un arbre 
la pointe 
, ^ le bout 

c) ^he cont extual sofncs D-E-F 

^y simply^manipulatin^^ the semes: 

Dogs "clrne" mean tho hi'^hcst p^*rt of 



a mountain ? 
a house ? 
a men ? 



or salGctinp, as iecoys the words havine +A, +B, +C and +D, or E oi 
Select the rig'ht pairs ^ cime . . house 



tSts . 
toit . 



• mountain 
« man 
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2, Synt^acticsl structures 

' UnderstanVlinr a sent once requires complex operations. 

No thQcrotical model exiots so far. which helps explaining tho 
performance^ of a sturjent during the recopnitiop process. How do 
we describe the process 6llowinn; to track the deep structure of 
^ tho sentence from the parsing of the surface structure, and/to 

associate a semantic msaninr, to the deep structure ? It certainly 
^includes: 

a) A "syntactical competonce" (knowledge of^the syntaRmatlcal 
and transformational rulos). 

h) A "semantical competence" (knowledge of the semantical rules 
allowinq to associate a meaning to tho deep structures) . 

c) The knowledge '^-^ tho lexicon (phonological and e.r^phical infor- 
mation, syntactical and semantical selection rules associated 
to ee.ch item) • ' * ' 

Analysis strategies which test (from a, '*'and> c) the mcst 
orcbeMe hypothesis and discard them as soon 3s something ^ 
imorcper h?.ppcns. Thi'S would imply the memorization. of the 
const ituonts which have already been analysed. Such prt)CGSSCS 
^ * hav3 L:e3n cescri^e:! in a sophisticated way C.S. Osp,.70d (1). 

c) Comp-^nsatorv devices which supply the deficiencies of the 
' misr^ine information and allow to assess a sentence its most 
prcba''le meaning? even if the sentence is not well -Formed or 
if the mossac^s is not completely received. 



(1) C.S. OSGOOD, 1953. 



Tha ideal procedure would be to analyse and test' each of these 
skills separately. Such a procedure is howtaver unmanageable, so far, 
tecauso any readinp, parformance involves them all at the same time. 
However, each of these variables can he approached in somo way: 

- Vocabulary tests may to concoived for evaluating as accurately as 
possible the lexical variat:le. The semantic properties of the 
wnnjs have been dascribed in the previous section. Items have to 
be written for testing the syntactical properties of the words. 

— Morphological tests might to concoived for evaluating the^know-, 
iQdcte -of the morphc-rhcnnlogical transformatiorjs (for instanco, 
the use of moaningless words or sentences): ^ 

Ex.: Which is th9 incorrect sentence^? ^ 
a) des p,lops paturent. 
X b) ds£ glops^ pature 

Ex.:. Which are the plural phrases ? 

a) un patur 

t) un gromp 
X c) des^ p.lcps^ 
x c!) ::!es^ patur^ 

•3) un fi;lop 
X f ) des^ grocnps^ 

- Once the researcher has assessed these two .'f imensionf of the 
student's performance (lexical and morphological skiUs) . he can 
measure other achievements. By askinp/tjOestions about kernel 
"sentences (NP-VP), one tests the ability to associate a meaning 
to a deep structure. 



X : target response. 
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It seems, nevertheless, much more difficult to isolate the 
other veriaMcs (Knowledcje of transformational rul9S, oxcopt morpho- 
logical ones). Whea'a child assigns a correct meaning to the sentence: 
"Marie loves Paul" t'ut an incorrect one to •'Paul is Icveci hy MariQ** 
(this sentence ?:eing un'^erstrioci as "Paul loves Marie'*), ws can explain 
this fact: 

a) Either t:Qcnus3 o-f? an imperfect knowledge of th? passive 
transformationcji rules. 

t) Or t:3cause the passive transformational rules have not been 
applied, i.e. the first nominal phrase has ^een considered as 
a su'^ject MP and this incorrect hypothesis has not !?CGn 
Sutsoqucntly discarded.' 

It should oossiMo tc create tests which wou^d measure 
soDaretely both of theso aspocts," tut each trar sfcrmotion or set of 
transformations v«^oulr^ roauire a specific instrument. We are not likely 
to set up a convenient procedure for generating itoms di^vissd for 
testing any trnnsform^tional rule. 

Hiereforo, it will probably l-o impossible to test the undcr- 
stan-'ing of transformed sent jnces ,by using the deoo structure in the 
quGGt :n. Items darived this way (1) would measure mixed operative 
processes. A more exhaustive study appliJd to well-defined linguistic 
data would allow t'^i define: 

- items measuring the knowledge of the rules. 

- items testing the recognition strategies. 



(1) This procedure has been suggested bv J« Bormuth (1969 rnd 1970). 
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3.* Anaphorical relations 

In the two latter section--, we have suggested convenient 
procedures for testing the knowledge of the vocabulary and of the 
syntactical structures. It seems much more difficult or even 
impossible, so far. to test the domain of semantics. Semantical 
selection rules are not wall-known and thus very difficult to tost. 
No criterion tests can here be designed j the const ruct.ion of tests 
related to the area of semantics is left this way to t^i decision 
of the item-writsr. 

h% montionned by J. Bormcth , anaphorical relations can 
however be tested. Bormuth defines an anaphora as a "pronoun- 
like structure in that it includes both a pro element and an ante- 
cedent". In fact, pronouns are one type of nnachora. Anaphora 
generally serve tha function of allowing authors to state a 
ccmploxly modifjicd conceot. set it equal to some shor-tor form, and 
thereafter refer to the complex con_jpt using just that shortened 
form. In order for a reader to understand a discourse, it seems 
neccss?ry' for him tc have acquired some set of orocesses which 
enable him to identify anaphoric expresjions of various types and 
correctly associate these anaphoric expressions with their oropjr 
antecedents. 
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In this prospact. benzol's claasiflcitlon of anaphoras (1) 



can bo ubgcJ: 



1, Pi^o Anaphora 

2. RoWrentisl Rgoatltlon Anaphora 

3, FoUqI Rgpotltion Afiephcra 

4. ClaW Incluslva Anaphora 
5* Synonymous Anaphorg 

6* 'Arit^imotlc Anftphnra 
7. Incliuslve Anaphorc ^ 
3. Derivational Anaphora^ 
9. Major Anaphcr^ 
10. Minor Anc^hora 



1 

Anaphoras do net cover the whole domain of semantics! 
how-vcr, thei can supoly somo svidcncQ about what haopens In this 



arc 



1 

Some pnc-duros of derivation of items from anaphoricp.1 relations 
have been described very orecisely by J. Bormuth (op. cit. pp. 50-53). 
It must bo emphasized that wc.we-nt to enlarge the nopulstion of items 
derived from e passage by using the semic schome of words described 
above (p. 17). This way. we approach -t tho s?.me time both lexical 
semantics end inter-sentonces relations. We are convinced that such 
a procedure taKes .into account some of the highest hierarchical skills 
nf- the reading process mastered by the students in the lov^jor grades. 



(1) P. tIENZEL, 1970. 
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•By using this rnethod, v/e hnve derived itoms upon ^nephoriCf'?! 
I'olpti'^ns frrm first grada passegfcs* Acccrding to the cbjoctives of 
tho tost-writcr who wants 'to test thi's snocific skill, it cculd, 
hnwovcr, rcvoal nocossary t-: write pe.ssagQS containing different 
kin'js cf anaphoras ^^nd to control ether variables. 

Clozo-tcsts 

Wc have .jbserved in the provinus secti.-7ns thrx seme crmpen- 
sfltory davices must bo .available which supply tho deficiencies ?f 
th3 missing informstinn* 

Let UP heve a look at some procedures convenient fcr testing 
this skill. Deleting or stumping letters and syllables within words 
could bo" used fcr testing tt^e decoding skills and the word rttack 
processes. Criterion procedures can easily be designed fcr achieving 
this p-^«l by selecting derivation rules cf items. 

Let us n'^w describe four prnceduros intended to measure 
reading ccmorehension which h^vo. been successfully used wi-^h first 
?nd second ^n^de students. ^ ^ 

a) From sentences isclatod from the context, a word is randomly 

selected. An item is then written by ch'ivrsing decoys from a basic 
vrc-bulary list. By taking 'or n-t syntr-cticol constraints into 
account, different skills moy be =»ppr'^achod . 

Ex. The it«m 

* X Paul 

•*L-- pipe do vile fume" 
b^it 

measures the kn-^wledgc of a syntactic'^1 constraint. 
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Ex. Tha item 

crangQ^Jdo 

"MnniouE l?vo son x ponou sftle" 

rhume 

" . rnoasuros tha Kmwlqrtje rf fl scnantici'l constraint. 

Such items heve bson doviscd and administered by E. Boxus and 
M. Oetheux CD ?t the Labrratnirs ds P6d2g.rtT i3 oxD6rim&nti-lg of 
the University cf Li6go. 

b) FUdn sentences isolated from the context, a word is randomly 
selected and deleted. Such cloze items h'jvc been administered by 
P." DYCKES (2) at the Institut P6daROglquo Na tional of Luxemburg. 
In the s^me study, he administered other reading sub-tpstfei by 
processing the correlation matrix he proved that thl^ skill was 
,-.t the tnp rf the hierarchy when other sub-tests wore considered. 

c) From passage, it proves vary eRsy t- build items as those 
described in a). 

d) Clrzo tests may be cmstructod from a" first grade passage. 

A pre-t3St administered by J. P. Rapaille (3) at the beginning of 
the schoolysar (2nd grade) proved to be very interesting for it 
allowed to -scartain thrt some students are able to use their 
lexical, syntactical and semantical competence for completing tho 
test. The very sKowod distribution nf the results reveals. 
hcwavGr. that such complex pr-'cosses are not yet mastered by a 
majority ^f stjdents bslonp^inf: to the ago proup. 



(1) Rcscr^rch project in pr^grt^ss. ^ 

(2) I.P.N. . Luxemburg. 1970. 

(3) J. P. RAPAILLE. Research prrjoct in pr-gress. Lab-ratoire de 
Pg(j-^g-gie experiment .^le . University cf Li6go. 
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CONCLUSIONS 



As a conclusion, let us new Gxpliin which eoals could be bsst 
nchiQVGc through the use cf tho model suggested. 

First of kll, the class-room teacher who has -to measure day 
by day the r<2ading achievement while learning is poing on* He cannot be 
satisfied with usual st'andardized tests ranking students acconl|ng to a 
gaassian reference distribution i a teacher who is aware of the real goals 
cf his teaching, cannot be highly concorncd by the traditional summative 
Jjvaluation. Wh^t ho wants is to knew accurately which reading skills have 
been mestored by student. Such c^n' accurate evaluation Ts needed before 
resorting to remedial procedures. The teacher urgently 'needs torls to 
test any reading skill h3 wants to. It would therefore be of a consi- 
derable help if we could provide him with a comolete list of possible 
items* The nr.Qcl suggested ce.n serve that purpose. 

In this persoBctlvG, we d** not have to bother about the' 
difficulty level cr the discrimin3tinn power o'f items. All wc need to 
know is that thqy h,»VQ b-aan generated by using ths model and r'^ro repre- 
'scntetive of th3 whole -^opulption cf items' measuring the skill. Of course, 
thJ teacher la, in mcst cases ^ not able tc master such n sophisticated 
technology. Sncciallzod research dcc^rtments must hole. 

Educ^tinn'»l reading researchers are concerned, too, by this 
mcdol- It night, f?r in^tancn, pr:ve very important to refer to valid 
criterion meesurss for assessing the predictive power of reading readiness 
t3Sts f^r studying the 'Prdrequisites of reading learning. The same 
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critaricn measures might also prcve important foe identifying learning 
effects of different reading methods ("1-sok-say", "phonics-,...), for 
calibrating basic readGrs, etc; ^ 

At hny level of -rsspcnsibility. educational authnfities are 
anxious to provide the best education according tr th3 avaiiablo 
resources. The butter primary readinr achievement, t+ie better would be any 
further scho-1 achievement. A reading evaluation model is indispensable 
for achieving any local or national surveys on reading, for it provides 
e large population of ronresentativs items belonging to well-defined 
sub-classes and allows by =the same token to utilize very reliable 
item-sampling techniques. 
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